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BACKGROUND OF THE INVENTION 



1. Fi eld of the Invention 

The present invention relates to memory allocation for real-time audio 
processing. In particular, the present invention relates to DRA]\4 bank 
switching for real-time audio data storage. 

2. D escription of Related Art 

Real-time audio signal processing requires fast access time. In a typical 
audio system, 1:here are general-purpose processor and specialized digital 
signal processor (DSP). The general purpose or host processor is any general 
central processing unit (CPU) such as those in a personal computer (PC). The 
host processor usually performs data storage, user interface, network control, 
and other general command and house keeping functions. The host 
processor also has interfaces to peripheral devices such as serial 
commimication, disk controllers (e.g., a hard disk controller). The DSP 
usually performs signal processing functions to process real-time audio data 
such as digital filtering. Multiple and separate memory banks are accessible 
to both the ho£>t processor or other direct memory access (DMA) devices such 
as a SCSI controller. 

Real-time audio signal processing usually involves three basic 
operational modes: recording, playback, and editing. 

During the recording mode, the audio data are sent from audio input 
channels and stored in random access memories (RAMs) by the DSP. The 



080398.P115 
MES/TVN/mns 



-1- 



Patent Application 
Filed September 24, 1997 



audio data are subsequently transferred to a storage device such as a hard disk 
drive via the S<Z!SI controller. 

During the playback mode, the audio data stored in the hard disk drive 
are first transferred to random access memory (RAM) via the SCSI controller. 
The DSP then accesses the RAM to process the audio data and output to the 
appropriate audio output charmels. 

The RAM is typically organized as multiple memory banks which are 
accessible to both the DSP and the SCSI controller. Traditional techniques 
involve transfeirring data to fill up a memory bank before going to the next 
memory bank. However, if a memory bank is busy for receiving data, it will 
not be immediately accessible to the DSP, resulting in processing delay. 

Accordingly, there is a need to provide an apparatus and method for 
efficient memory allocation for real-time audio signal processing. 
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SUMMARY OF THE INVENTION 



The present invention discloses a method for allocating real-time 
audio data froin N audio channels in a system having a first processor and a 
second processor. The method comprises the steps of: (1) providing P 
memory banks where each memory bank is accessible to the first and second 
processors; and (2) storing P subsets of the audio data in P memory barJcs, 
respectively, where the P subsets correspond to P different groups of audio 
channels. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The features and advantages of the present invention will become 
apparent from the following detailed description of the present invention in 
which: 

Figure 1 is a block diagram illustrating one embodiment of an audio 
player/ recorder system that operates in accordance with the teachings of the 
present invention. 

Figure 2 is a diagram illustrating one embodiment of an embedded box 
in the audio player /recorder system. 

Figure 3 is a diagram illustrating one embodiment of memory banks. 

Figure 4 is a timing diagram illustrating the sampling of an audio 

signal. 

Figure 5 is a diagram illustrating one embodiment of the allocation of 
sampled audio data stored in the memory banks. 

Figure 6 is a flowchart of one embodiment of a process for reading and 
playing back of audio data in accordance with the principles of the present 
invention. 
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DESCRIPTION OF THE PRESENT INVENTION 



The present invention discloses a method for efficient memory 
allocation to reduce memory waiting time in a real-time audio signal 
processing system. The memory is divided into separate memory banks for 
5 independent accesses by the host processor and the digital signal processor 
(DSP). The audio samples are stored in the memory banks in an interleaving 
manner to distribute the memory access over multiple memory banks. This 
memory allocation allows a small computer system interface (SCSI) controller 
and the DSP equal access to the memory banks. 

10 In the following description, for purposes of explanation, numerous 

details are set forth in order to provide a thorough imderstanding of the 
present invention. However, it will be apparent to one skilled in the art that 
these specific details are not required in order to practice the present 
invention. In other instances, well known electrical structures and circuits 

15 are shown in block diagram form in order not to obscure the present 
invention unnecessarily. 

Referring to Figure 1, a block diagram illustrating one embodiment of 
an audio player /recorder system 100 that operates in accordance with the 
teachings of the present invention is shown. The system 100 comprises 
20 embedded boxes (EBX) EBXl through EBXN llOi through HON ("N" being a 
whole positive number), K remote client computers (RCCs) 120i through 
120k C'K'' being a positive whole niimber), network channel 115, audio 
engineering society (AES) standard input/output channels 125, and 
synchronizing clock 130. 
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Each of the EBX llOi through HON is an audio signal processing 
system with mass storage. In one embodiment, each EBX includes a personal 
computer (PC) system and one or more digital signal processors (DSPs). Other 
configurations that provide similar functionalities are also contemplated. 
5 Audio sampled data are stored in multiple dynamic random access memory 
(DRAM) banks. These DRAM banks are accessible to both the host processor 
of the PC and Ihe DSPs. The details of the EBX architecture will be discussed 
later. 

Each of the RCC's 120l through 120k provides graphical user interface 
10 (GUI) to users for sending command and control information to the EBXes 
llOl through HON over the network channel 115. Each RCC has two modes 
of communication with the EBXes: individual addressing and broadcasting. 
In individual addressing, the RCC issues the command /control information 
to the specified EBX. The individual address of the destination is encoded as 
15 part of the command /control information. 

The AES I/O channels 125 consist of 16 audio I/O channels per EBX 
conforming to the AES standard. The standard is AES 3-1992 and is available 
from the Audio Engineering Society, Inc., located in New York, New York. 
The synchronizing clock 130 provides a master timing signal for 
20 synchronizing all real-time activities of the EBXes llOl through HON- 

Referring to Figure 2, a block diagram illustrating one embodiment of 
the EBX 110 is shown. The EBX 110 comprises one or more processors 205 1 - 
205m C'M" being a positive whole number) and a main memory element 230 
(e.g., dynamic random access memory "DRAM", static random access 
25 memory "SRAM" etc.) coupled together by a chipset 220. In general, the 
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chipset 220 operates as an interface between a host bus 210 and a peripheral 
bus 235. 

Processors 205i - 205m are any microprocessors. In this embodiment, 
processors 205i - 205n are the Pentium® or Pentium Pro® microprocessors 
manufactured by Intel Corporation at Santa Clara, California. 

Chipset 220 typically includes cache DRAM controller (CDC), peripheral 
bus controller, and data path imit (DPU). The Peripheral Component 
Intercormect (PCI) Bridge (PB) provides a set of host-to-PCI and PCI-to-host 
bus transactiorL translations. 

The host bus 210 is a bus that can support transactions to a number of 
connected processors. Host bus 210 may be referred to as a parallel bus or 
multiprocessor bus because it supports parallel operations and multiple 
processors. It is contemplated that host bus 210 operates in a pipelined 
manner to increase efficiency. However, these features should not be 
construed to limit the teachings of the present invention. The present 
invention can be utilized even if there is only one processor cormected to the 
host bus 210, or the host bus 210 is a uniprocessor bus. 

The peripheral bus 235 provides a communication path between the 
processors 2051-205M or main memory element 230 and a plurality of 
peripheral devices 250i-250p ('T" being a positive whole number). These 
peripheral devices 250i-250p may include I/O devices such as disk controller 
250i, local area network (LAN) card 2502- In one embodiment, the disk 
controller 250] is a small computer system interface (SCSI)-2 controller which 
is interfaced to a number of mass storage devices such as optical read /write 
drive 252 and hard drive 254, through the SCSI-2 bus. Relevant to the present 
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invention is the signal processing subsystem (SPS) 270 which includes digital 
signal processors (DSPs), multiple dynamic random access memory (DRAM) 
banks and PCI bus interface circuits. The SPS 270 has interface to the serial 
input/output c:ommunication device 272 which is connected to ithe AES I/O 
channel interface 274. The peripheral bus 235 may include a Peripheral 
Component Interconnect (PCI) bus or any other type of bus architecture. 

The expansion bus 255 provides a communication path between the 
peripheral bus 235 and a plurality of expansion peripheral devices 260i-260l 
("L" being a positive whole number). The expansion bus 255 may include an 
Industry Standard Architecture (ISA) bus or an Extended Industry Standard 
Architecture (EISA) bus. 

The PCI-to-ISA/EISA Bridge 240 provides the commimication path 
between the peripheral or PCI bus 235 and the expansion or ISA/EISA bus 255. 

The term PCI processor refers to a processor that can have control of 
the PCI bus for data transfers. A # symbol after a signal name indicates an 
active LOW sij^nal. The absence of such symbol indicates an active HIGH 
signal. The notation Ox refers to a hexadecimal notation. 

The SPS 270 includes one or more digital signal processors (DSPs) and a 
number of memory banks. The SPS 270 includes a memory system 300 that 
operates in accordance with the teachings of the present invention. 

Referring to Figure 3, a block diagram illustrating one embodiment of 
the memory s^/^stem 300 is shown. Memory system 300 comprises two 2-to-l 
multiplexers MUXO 310 and MUXl 311 and two memory banks DRAM 
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BANKO and DRAM BANKl 320 and 321. As will be explained later, a system 
having N memory banks can be used with N 2-to-l multiplexers. 

MUXO 310 and MUXl 311 are 2-to-l multiplexers connected to the DSP 
bus and the PCI bus (for SCSI access) and to the DRAM BANKO 320 and 
5 DRAM BANKl, respectively. Each of the MUXO 310 and MUXl 311 
conceptually consists of two multiplexers: address multiplexer 
(unidirectional.) and data multiplexer (bi-directional). For clarity, only one 
multiplexer is shown and the direction is shown to be bi-directional. In the 
present embodiment, the multiplexers are realized by the bi-directional 
10 switches Part No. QS3257 or similar devices manufactured by Quality 
Semiconductor (Santa Clara, California). 

MUXO 310 and MUXl 311 are controlled by the SELO and SELl signals, 
respectively. ^Nhen SELO and SELl are at a first logic level (e.g., LOW), the 
data transfer is between the selected DRAM bank and the PCI bus (SCSI 
15 controller). When SELO and SELl are at a second logic level (e.g., HIGH), the 
data transfer i!5 between the selected DRAM bank and the DSP bus. 

DRAM BANKO 320 and DRAM BANKl 321 are two dynamic random 
access memory?' (DRAM) banks operating separately and independently. As is 
well known by one skilled in the art, other types of memory such as static 
20 RAM can also be used. In one embodiment, each DRAM bank is organized as 
4Mx32 or 16 Mbytes. 

By controlling the SELO and SELl, the two DRAM banks can be accessed 

simultaneously by two different processors. For example, the SCSI controller 

may access Dl^M BANKO 320 for storing data while the DSP is reading the 

25 data out from DRAM BANKl 321. 
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Referring to Figure 4, a timing diagram 400 illustrating the sampling of 
audio signals is shown. Timing diagram 400 consists of audio clock 410, clock 
(CLK) 420, and audio sampled data 430. 

Audio clock 410 is a clock that correspond to the audio sampling rate of 
48 KHz which results in a sampling period of approximately 20 microseconds. 
In one embodiment, during each sampling period, 16 samples from 16 audio 
channels are received from the serial AES input ports and stored in the 
DRAM banks m recording mode. During the same sample period, the 
playback of the digital audio is done by reading the data stored m the DRAM 
banks and sending it to the serial AES output ports. 

CLK 420 indicates the separation of 16 charmels during each audio clock 
period. Audio sampled data 430 show the series of sampled audio data. Each 
of the sampled data corresponds to an audio sample at each channel. The 
number of samples obtained at each time interval depends on the number of 
selected channels. In one embodiment, the number of selected channels is 16. 
For the embodiment shown in Figure 4, during time interval Tl, 16 samples 
from 16 channels, one from each charmel, are obtained. Thereafter, the next 
16 samples from 16 charmels obtained during time interval T2. 

Referring to Figure 5, a diagram showing the allocation of audio 
sampled data in the two memory banks is shown. DRAM BANK 0 is 
configured to store audio sampled data from channels 0, 2, 4, , . . 14 (the even 
channels). DRAM BA^JK 1 is configured to store audio sampled data from 
channels 1, 3, 5, . . . 15 (the odd channels). 

This allocation scheme can be extended to more than two memory 

banks. The objective is to distribute equally the storage of all audio channels 
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over the entire memory banks so that the access of all 16 channcjls is not 
concentrated into one or a few memory banks. With this equal allocation, 
there is less chance for the SCSI controller and the DSP to access to the same 
memory bank at the same time. Even when they do, one processor does not 
5 have to wait for too long for its turn to access memory. The result is that 
audio sampled data are written into or read out of the memory banks at a 
faster rate to accommodate real-time processing. 

For example, if there are P memory banks, DRAM BANKO will store 
sampled data ixom charmel 0, channel P, channel 2P, channel 3P, etc. DRAM 
10 BANKl will store sampled data from channel 1, channel P+1, channel 2P+1, 
channel 3P+1, etc. DRAM BANKP will store sampled data from charmel P-1, 
channel 2P-1, c:hannel 3P-1, etc. In general, each DRAM bank should store a 
subset of audio data which corresponds to a different group of audio channels. 

Referring to Figure 6, a flowchart showing the process S600 to read the 
15 audio samples from mass storage and playback the audio data, is shown. In 
this embodiment, two memory banks (DRAM BANKO and DRAM BANKl) 
are used. Recording is accomplished using the same memory allocation 
method. 

Proceeding from a START state, the process S600 enters step S610. In 
20 step S610, the host processor determines the location of the audio data which 
will be used to instruct the SCSI controller to read the audio sampled data 
from the hard disk or other mass storage devices. The process S600 next 
enters the decision step S620 to determine whether the channel number is 
even or odd. If it is determined that the channel number is even, the process 
25 S600 enters the step S630 to select and allocate a block of memory in the 
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DRAM BANKO for storing the sampled data. Thereafter, the process S600 
enters the step S640 to write the audio sampled data into the DRAM BANKO. 
The process is then terminated. 

If it is determined that the channel number is odd, the process S600 
5 enters the step S631 to select the DRAM BANKl for storing the sampled data. 
Then in step S641, the audio sampled data is written into DRAM BANKl, 
The process is then terminated. 

While this invention has been described with reference to illustrative 
embodiments, this description is not intended to be construed in a limiting 
10 sense. Various modifications of the illustrative embodiments, as well as 
other embodiments of the invention, which are apparent to persons skilled 
in the art to which the invention pertains are deemed to lie within the spirit 
and scope of the invention. 
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What is claimed is: 



1 1, A method for allocating real-time audio data from N audio diarmels 

2 in a system having a first processor and a second processor, the method 

3 comprising the steps of: 

4 providing P memory banks, each memory bank being accessible to the 

5 first and second processors; and 

6 storing F subsets of said audio data in P memory banks, respectively, P 

7 subsets corresponding to P different groups of audio channels. 



1 2. The method of claim 1, prior to the step of storing, further comprises 

2 a step of selecting said memory banks for access by one of the first and second 

3 processors. 

1 3. The method of claim 1 wherein P is equal to two. 



1 4. The method of claim 3 wherein one subset of said audio data 

2 corresponds to even-numbered audio charmels and one other subset of said 

3 audio data corresponds to odd-numbered audio channels. 



1 5. A sysjtem having first and second buses for processing real-time 

2 audio data from N audio channels, the system comprising: 
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a first processor and a second processor coupled to said first and second 
buses, respectively; and 

P memory banks coupled to said first and second buses for storing said 
audio data, said P memory banks being accessible to said first and second 
processors, said P memory banks storing P subsets of said audio data, 
respectively, said P subsets corresponding to P different groups of audio 
channels* 

6. The system of claim 5 further comprises P selectors coupled said first 
and second buses to select said memory banks for access by one of said first 
and second processors. 

7. The system of claim 6 wherein P selectors include P address 
multiplexers and P data transceivers. 

8. The system of claim 5 wherein one subset of said audio data 
corresponds to even-numbered audio channels and one other subset of said 
audio data corresponds to odd-numbered audio channels* 

9. The system of claims 5, wherein the P memory banks include 
dynamic random access memories* 
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ABSTRACT OF THE DISCLOSURE 



The present invention discloses a method for allocating real-time 
audio data from N audio channels in a system having a first processor and a 
second processor. The method comprises the steps of: (1) providing P 
memory banks where each memory bank is accessible to the first and second 
processors; and (2) storing P subsets of the audio data in P memory banks, 
respectively, where the P subsets correspond to P different groups of audio 
channels • 
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